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Sampling method, reconstruction method, and device for sampling 
and/or reconstructing signals 

The present invention relates to a sampling method, a 
reconstruction method and related devices for sampling and/or 
5 reconstructing signals. 

With the increasing use of digital devices in all scientific and 
technical fields, the need for reliable acquisition devices equally increases. 
The role of these devices is to acquire the analog signals or waveforms of 
the continuous-time world and convert them in time-discrete digital signals 

10 which can then be processed by said digital devices, for instance to perform 
some computational operations such as processing, decoding or 
reconstructing the analog waveform. Such acquisition devices are used in 
many areas of science and technology, including for example scientific 
measurements, medical and biological signal processing, 

15 telecommunication technology, etc 

The acquisition devices sample the analog waveform at uniform 
sampling intervals and with a regular sampling frequency, thus generating 
a set of sampled values of the sampled signal. It is critical in most sampling 
schemes to use the smallest set of representative samples needed to fully 
20 represent and eventually allow the faithful reconstruction of the analog 
waveform. In other words, the smallest sampling frequency still allowing a 
faithful representation of the first signal is the goal. 

The sampling and reconstruction methods currently used in 
common acquisition devices are based on the sampling theorem of 
25 Whittaker, Kotelnikov and Shannon. 

This theorem states that a signal, for example a received signal 
y(t), bandlimited to the frequency band [-co m , co m ], can be completely 
represented by samples y s [n] spaced by an uniform sampling interval T if 
the sampling rate 2nfT is at least twice the bandwidth co m . 
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This sampling scheme is represented on Figure 1. The lowest 
sampling frequency 2co m given by this theorem is commonly referred to as 
the Nyquist rate or Shannon frequency. In other words, the minimal 
sampling frequency directly depends on the bandwidth of the analog 
5 signal y(t) to sample and/or reconstruct. 

The reconstruction method related to this sampling theorem 
allows a perfect reconstruction of a signal y(t) by superposing regularly 
spaced sine functions regularly delayed by the value of one sampling 
interval T and weighted by the successive sampled values y 5 [n] of the 
io sampled signal. This well-known reconstruction scheme is illustrated on 
Figure 2, where the bloc 1 illustrates the sine reconstruction filter. 

If the signal y(t) to sample and/or reconstruct is a non- 
bandlimited signal, or if its bandwidth is too high to sample it at an 
acceptable sampling frequency, one usually filters it with a lowpass filter, 

is thus generating a bandlimited lowpass version of the signal. This lowpass 
version of the signal can then be sampled and reconstructed with the 
above-described sampling and reconstruction schemes. The lowpass 
filtering can be performed by a dedicated lowpass filter circuit, by the 
transfer function of a transfer channel over which the signal y(t) has been 

20 transmitted, and/or by the transfer function of a measuring device or 
demodulating circuit used for acquiring this signal. 

Therefore, when sampling and reconstructing a non-bandlimited 
signal y(t) or a bandlimited signal having a frequency spectrum with non- 
zero Fourier coefficients for frequencies higher than half of the sampling 
25 frequency 2co m , current sampling and reconstruction methods imply a 
distortion of the reconstructed signal with respect to the sampled signal. 

In order to avoid the above mentioned problem, one usually uses 
a higher sampling frequency, thus allowing perfect reconstruction of a 
broader range of signals and minimizing distortion for non-bandlimited 
30 signals or wideband signals. A high sampling frequency however requires 
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fast, expensive and power-consuming A/D converters, fast digital circuits 
and a waste of storage place for storing the digitized signal. 

Furthermore, there are wide classes of very common signals, 
including stream of Dirac pulses, bilevel signals, piecewise polynomial 
5 signals, etc., which are not bandlimited and which therefore cannot be 
sampled and faithfully reconstructed by the known methods, even by 
increasing the sampling rate. 

An aim of the present invention is to find a sampling method and 
a related reconstruction method for sampling at least some classes of non- 
10 bandlimited signals and for allowing an exact reconstruction of these 
signals from the samples generated with said sampling method. 

Another aim of the present invention is to find a sampling 
method and a related reconstruction method for sampling at least some 
classes of bandlimited signals with a sampling frequency lower than the 
15 frequency given by the Shannon theorem and still allowing an exact 
reconstruction of these signals. 

Another aim of the present invention is to find an improved 
method for sampling and faithfully reconstructing signals with a finite rate 
of innovation which can only be seen through an imperfect measuring 
20 device, a transfer channel and/or a modulating system having not 
necessarily a bandlimited transfer characteristic. 

These aims are achieved with a sampling method and a 
reconstruction method including the features of the corresponding 
independent claim. 

25 In particular, these aims are achieved with a new sampling 

method for sampling and faithfully reconstructing signals having a finite 
rate of innovation, i.e. having, over a finite time interval, a finite number 
2K of degrees of freedom. In particular, the invention concerns the 
sampling and reconstruction of signals which can be completely 
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represented by the superposition of a finite number K of known functions 
delayed by arbitrary shifts (t n , tk) and weighted by arbitrary amplitude 
coefficients c n , Ck. 

The Shannon theorem indicates that bandwidth limited signals 
5 can be exactly specified by sampling values y s [n] taken at uniform sampling 
intervals if the sampling rate is at least twice the bandwidth. The invention 
is based on the finding that a larger class of signals, i.e. signals having a 
finite number 2K of degrees of freedom over a finite time interval, can be 
exactly specified by a finite set of shifts and associated weights. It can be 
io shown that, in many common cases, the minimal number of values 2K, or 
even 2K+1 , is much lower than the number of samples required for 
faithfully reconstructing a signal with the existing reconstruction methods. 

As an example, in the case of a CDMA communication system, 
each symbol (information bit) of each signal sent by each user is modulated 

i5 with a coding sequence (signature) which can for example be 1023 chips 
long. In this case, the chip rate of the transmitted signal is thus 1023 times 
higher than its symbol rate. Modulating a signal with the coding sequence 
thus expands the signal's bandwidth by the value of the spreading factor, 
here 1023. Sampling and reconstructing a received CDMA signal with the 

20 conventional sampling and reconstruction methods thus requires a very fast 
and therefore complex and expensive analog sampling device. As the 
number of degrees of freedom in each received signature is at most two 
(shift and weight of the signature), the method of the invention can be 
used for sampling the received signal at a much lower rate whilst still 

25 allowing a faithful reconstruction of the sequence of symbols sent. 

It is important to understand that, in the sampling method of the 
invention, the signal (or a filtered version of the signal) is still sampled at 
uniform sampling intervals, using for example common regularly clocked 
sampling devices. It is only for the reconstruction of the signal from the set 
30 of sampled values that a set of shifted values is computed. In most cases, 
those shifted values do not correspond to samples of the signal to 
reconstruct. 
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The inventive sampling method first convolves the signal x(t) with 
a sampling kernel and then samples the convolved signal at regular 
sampling intervals, both the sampling kernel and the sampling frequency 
being chosen such that the sampled values completely specify the first 
5 signal, thus allowing a perfect reconstruction of said first signal. The 
sampling frequency used for the inventive sampling method can be lower 
than the frequency given by the Shannon theorem, but is greater than or 
equal to the rate of innovation of the signal to reconstruct. 

The inventive reconstruction method reconstructs a first signal 
io x(t) from a set of sampled values taken from this signal x(t) or from a 
second related signal y(t) regularly sampled at a sub-Nyquist rate by 
retrieving from the regularly spaced sampled values a set of shifts and 
weights with which the first signal can be completely specified and 
reconstructed. 

15 In particular, the inventive reconstruction method can be used 

for reconstructing, from a set of at least 2K sampled values, any signal 
which can be represented by the superposition of K known functions 
delayed by arbitrary shifts and weighted by arbitrary amplitude coefficients 
(weights). A preferred embodiment of the inventive reconstruction method 

20 comprises the steps of first solving a structured linear system for retrieving 
said arbitrary shifts and then retrieving the arbitrary weights using the 
previously retrieved arbitrary shifts. 

Note that for some applications it may be sufficient to retrieve 
the shifts and that the weights are only needed if a complete 
25 reconstruction of the signal is needed. This is for instance the case during 
an estimation session in a CDMA decoder, when one wants to estimate the 
relative delays (shifts) occurred by the different users' signals along 
different propagation paths. 

The lowest sampling frequency required in the method of the 
30 invention directly depends on the rate of innovation of the signal to 
sample and/or reconstruct, and not on its bandwidth as in prior art 
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methods. More precisely, the sampling frequency required by the sampling 
method of the invention must be greater than or equal to the rate of 
innovation of the signal to sample. A minimal sampling frequency can thus 
be determined for any signal with a finite rate of innovation, including for 
5 some non-bandlimited signals. 



a signal is defined as the number of degrees of freedom of the signal 
within a time period. For example, a signal x(t) made of K weighted Dirac 
pulses, even if clearly not bandlimited, can be fully specified by the K 
10 occurrence times (shifts) t k and by the K amplitudes (weights) c k of the 
Diracs. The signal can be written as 



The degree of freedom of this signal is 2K. Its rate of innovation 
p is thus finite and equal to 2K/x, where x is the time interval in which these 
15 K Dirac pulses occurred. 

If the Dirac pulse function 5(t) is replaced by any other known 
function y(t), the number of degrees of freedom of the signal obviously 
always stays 2K, that is K occurrence times, or shifts, tk and K amplitudes, or 
weights, C|<. 

20 Considering the more general case of an unlimited time- 

continuous signal, for example a sequence of regularly spaced Dirac pulses 
with a space T between the pulses, the signal can be represented as 



In the specification and in the claims, the rate of innovation p of 



K-1 



x(t) = £c k 8(t-t k ). 




25 



where the degrees of freedom of the signal are the coefficients 
c n - The number of degrees of freedom per time interval T is therefore equal 
to one. The rate of innovation of this signal is thus p=1/T. Such a signal 
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could for example be a Pulse Amplitude Modulated (PAM) signal where the 
coefficients c n represent the value of the information data to be 
transmitted. 



5 function y(t) doesn't change the rate of innovation of the signal. The signal 



thus also has a rate of innovation p=1/T. There are many 
examples of such signals, for example when y(t) is a scaling function in a 
wavelet multi-resolution framework, or in approximation theory using 
io uniform splines. 



Assuming that the function y(t) is known, the degrees of freedom 
15 of the signals over a time interval T are the weights c n and the shifts t n . 
Thus the rate of innovation is p=2n/T. 

A signal could also be represented as a superposition of a 

determined set of functions {T r (t)} r =o r. instead of the unique function tft). 

It can thus be written as 



Again, replacing the Dirac pulse function S(t) by any other known 




If the superposed copies of the function y{t) are shifted by 
arbitrary shifts t n# the signal can be written as 




20 




For example, y r could be a Dirac, a differentiated Dirac, a 
polynomial function, etc. Likewise, a multi-user CDMA signal x(t) is the sum 
of a plurality of weighted and shifted known signatures y r of the users. 



WO 02/078197 



8 



PCT/EP02/03380 



Again, assuming that the functions yr(t) are known, the degrees 
of freedom of the signal x(t) are the coefficients c nr and the time instants t n . 
With the introduction of a counting function c x (t a ,tb) which counts the 
number of degrees of freedom in the signal x(t) over a time interval [t a ,tb], 
5 the rate of innovation p can be defined as 



p - lim — c 



2*2) 



Signals with a finite rate of innovation p can be completely 
determined and faithfully reconstructed with a set of at least p/2 weights 
(c n , Cnr, Ck) and p/2 shifts (t n , tk) per unit of time and with the knowledge of 
io the functions y r (t) which only depend on the class of the signal to 
reconstruct (stream of pulses, piecewise polynomials, etc.). 

The rate of innovation p can also be defined locally with respect 
to a moving window of size x. Given a window of time x f the local rate of 
innovation p t (t) at time t is 

is /> r (0 = -C,(/-r/2,* + r/2). 

x 

In this case, as the rate of innovation p t of the signal determines 
the lowest required sampling frequency needed for sampling the signal 
with the inventive sampling method, it is necessary to determine the 
maximal local rate of innovation p m ax(x) 

20 p max =maxp T (t). 

Applications of the new sampling and reconstruction methods 
can be found in many technical fields, including signal processing, 
communication systems and biological systems. The sampling and 
reconstruction methods can for instance be used for sampling and 
25 reconstructing wideband communication signals, such as CDMA signals, or 
ultra-wideband communication signals, such as PPM signals and time- 
modulated ultra-wideband signals, among others. 
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Various embodiments of the new sampling method and of the 
related reconstruction method applied to different classes of signals with 
finite rate of innovation are explained in the specification. The one skilled 
in the art will understand however that the invention is not limited to the 
5 specific examples given and that advantageous technical effects can be 
obtained by sampling and reconstructing other kinds of signals with a finite 
rate of innovation. 

The invention will be better understood with the help of the 
figures in which: 

io Figure 1 diagrammatically illustrates a sampling device and 

method using the already known Shannon theorem. 

Figure 2 diagrammatically illustrates a reconstructing device and 
method using the already known Shannon theorem. 

Figure 3 illustrates a communication system in which the 
15 sampling and reconstruction method of the invention can be used for 
sampling the signal y(t) and reconstructing any of the signals x,-(t). 

Figures 4 illustrates a sampling device according to the invention. 

Figure 5 shows one period x of a periodic stream of Diracs x(t). 

Figure 6 shows the Fourier transformation of a periodic stream of 

20 Diracs. 

Figure 7 shows the Fourier transformation of a bandlimited 
periodic stream of Diracs. 

Figure 8 shows the Fourier transformation of a sampled 
bandlimited, periodic stream of Diracs. 



25 



Figure 9 shows an example of bilevel signal. 
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Figure 10 shows a box spline cpo(t/T). 
Figure 1 1 shows a hat spline (|>i(t/T). 

Figure 12 illustrates a two-dimensional picture signal with a 0/1 
transition given by an arbitrary function. 

5 Figure 13 illustrates a two-dimensional picture signal with a 0/1 

transition given by a smooth, for example a bandlimited, function. 

Figure 14 illustrates a two-dimensional picture signal with a 0/1 
transition given by a piecewise polynomial function. 

Figure 3 diagrammatically illustrates a communication system in 

io which the sampling and reconstruction method of the invention can be 
used. The system comprises a signal Xi(t) which is modulated by a 
modulating device 3 having a known transfer function cpi(t). The resulting 
modulated signal x 2 (t) is transmitted over a transmission channel 5 with a 
transfer function cp 2 (t). Noise may be added to the signal x 3 (t). The 

15 transmitted signal x 3 (t) is acquired or measured by a measuring device 7 
with a transfer function cp 3 (t). The measured signal X4(t) is demodulated by 
a demodulating device 9 with a known transfer function quCt). The 
demodulated signal x 5 (t) is filtered by a filter 1 1 with a known transfer 
function <p 5 (t), for instance a lowpass filter in the sampler. In the following, 

20 the combination of transfer functions <pj(t) by which the sampled signal y(t) 
is related to the signal Xj(t) one wishes to reconstruct will be designated by 
<p(t), and the reconstructed signal will be designated x(t). The filtered signal 
x 6 (t)=y(t) is sampled at uniform sampling intervals by a sampling device 13 
working at a sub-Nyquist rate, generating a set of sampled values y s [n]. This 

25 set of sampled values can be stored, processed, transmitted, etc., and used 
by a reconstruction device 15 for reconstructing the signal y(t) or, if the 
transfer functions q>j(t) are known or at least if they have themselves a finite 
rate of innovation, any of the signals Xj(t). Depending on the application, 
one may wish to reconstruct the sampled signal y(t) or any signal Xj(t) 
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related to the sampled signal y(t) by a known transfer function, or at least 
by a transfer function which has itself a finite rate of innovation. 

Figure 4 illustrates a sampling device 13 with a filter 1 1 able to 
carry out the sampling method of the invention. The aim of the sampling 
5 device is to generate a set of sampled values y s [n] from the signal y(t) 
having a known finite rate of innovation p, where this set of value y s [n] 
must completely specify the signal to reconstruct x(t). 

According to the sampling method of the invention, the signal to 
sample x(t) is first filtered with a lowpass filter, for example with the 
io lowpass filter 1 1 or with a combination of the elements 3-1 1 in the system 
of Figure 3, having an impulse response q>(t), for instance q>s(t). 
Advantageously, the impulse response cp s (t) of the lowpass filter has a 
bandwidth of p/2. 

Calling x(t) the signal to reconstruct, its filtered version is 

15 y(t) = x(t)*cp(t) 

where 
<p(t) = 9(-t) 

is the convolution kernel (transfer function of the filter 3-11). 
Then, uniform sampling of y(t) with a sampling interval T leads to samples 
20 y 5 [n] given by: 

yM = fa* " nT)x(t)dt 

By choosing a sampling frequency f=1/T greater or equal to the 
rate of innovation of the signal x(t) to reconstruct, we will show that the 
samples y s [n] allow for a faithful reconstruction or decoding of the signal 
25 x(t), as will be illustrated by the not-limiting following examples. 
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Periodic sianals with finite rate of innovation 

In an embodiment, the new sampling and reconstruction 
methods are applied to the sampling and/or reconstruction of a periodic 
first signal x(t) with finite rate of innovation p over its period x. As 
5 examples, we will consider streams of weighted Diracs and periodic 
piecewise polynomials. Although the demonstration will be made using 
continuous-time periodic signals, similar results could be achieved with 
discrete-time periodic signals. 

A periodic stream of K Diracs at locations t k , weighted by weights 
io c k and with a period x, can be written as 



K 
\ 

n k=0 



x(0 = II^-(^+«r)) 



One period x of a stream of Diracs x(t) is shown on Figure 5. Each 
period of x(t) can thus be represented by the superposition of K Diracs 
delayed by shifts t k and weighted by weights c k . This signal x(t) can thus be 
15 fully determined by knowing the values of the K amplitudes and the K 
shifts of the K Diracs. It has therefore 2K degrees of freedom per period x 
and its rate of innovation p is equal to 2K/x. However, the bandwidth of x(t) 
is clearly not limited, so that x(t) cannot be sampled and faithfully 
reconstructed with existing methods. 

20 According to the sampling method of the invention, this first 

signal x(t) is first convolved by a filter 3-1 1 with a sampling function cp(t) f 

" — K K " 

for instance the sine sampling kernel of bandwidth 



, and then 



IK 

sampled at a sampling frequency f=1/T greater than — . 



The Fourier series coefficients X[m] of the signal x(t) are given by 



K-\ 2nmr t . 



25 x[m) = -Y J c k e" T (Figure 6) 

7 *=o 
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The filtered signal y(t), resulting from the convolution of the first 

— K K 

signal x(t) with the sine sampling kernel of bandwidth 



IT T J 



is a lowpass 



approximation of the first signal x(t) given by 
y(t)= £x[m]e « 



m=-K 



Figure 7 shows the Fourier series Y[m] coefficients of y(t). 

Sampling one period x of the filtered signal y(t) at multiples of T, 
we obtain M=x/T sampled values y 5 [n]. In a preferred embodiment, T is a 
divider of x. 



.2nmnT 



y s [n]=y(nT)= £X[m)e 1 = < x(t), <p(t -nT)> 

10 where ne[0, x/T-1]. 

y(nT) is periodic with a period x/T. Figure 8 shows the Fourier 
series coefficients Y s [m] of y s [n]. The Fourier coefficients Y s [m] can be 
computed from the set of N sampled values y(nT) of the filtered signal y(t) 
by using for instance the well-known Fast Fourier Transform (FFT) method. 



15 It can be shown that if the number x/T of samples per period is 

greater than or equal to 2K+1, the samples y s [n] are a sufficient 
representation of x(t). 

The following method can be used for reconstructing the signal 
x(t) from the coefficients Y s [m]. The Fourier coefficients X[m], computed 
20 from the samples y s [n] with a known method, are a linear combination of K 
complex exponentials: 



2 mm k 
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The shifts tk of the K Diracs can be determined from the samples 
using for instance an annihilating filter. A filter (1-z" 1 u k ) is called an 
annihilating filter for w™ if 



{l-z- { u k )u™ =0 



5 In order to find the shifts tk, an annihilating filter H(z) has to be 

determined whose coefficients are (1, H[1], H[2], H[K]) or 



H(z) = 1 + H[l]r 1 +H[2fc" 2 +-- + H[K)z- K =£H[m]z- 



m=0 



and which annihilates each exponential u™ . It can be shown that 
the K shifts of the Diracs {t 0 , t 1r t k -i} are given by, or at least can be 
10 retrieved from the zeros of the filter H(z). 



The filter H(z) can be found by solving the following structured 
linear equation system for H: 



x[o] 

X[1] 



X[-1] 

x[o] 



X[K-1] X[K-2] 



X[-(K-1)] 



x[o] 





■H[1]1 




rxwi 




H[2] 




X[2] 




H[K]. 




X[K] 



Because the matrix is a Toeplitz system, fast algorithms are 
15 available for finding the solution. This system has a unique solution if the 
first matrix is invertible, which is the case if all K Diracs in x(t) are distinct, 
that is if tk*ti, Vk*l. 



Given the coefficients 1, H[1], H[2], H[K] the filter H(z) can be 
factored into its roots 



20 



H(z) = f[(l-u k z-') 

k=0 
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which leads to the K shifts t k using the above given relation 
between u k and tk. 



solving 



Given the shifts tk, the K values of the weights Ck can be found by 



1 K-1 2irmt k 



which leads to the following Vandermonde system 



1 1 



r x[o] i 




X[1] 


_ 1 




T 


X[K-1] 





u 0 u, 



J K-1 



K-1 J L>K-1J 



which again has a unique solution when the K shifts tk are 
distinct, tk*ti, Vk*L Because the matrix is a KxK Vandermonde equation 
10 system, known fast solution methods are available. 

This result can easily be extended to a periodic stream of 
differentiated Diracs: 



oo R„-1 



x(t)=tXc nr 5 (r »(t-t n ) 

n=-» r=0 

with the periodicity conditions t n+ K=t n +x and Cn + K,r=Cnr for all n. 

15 This first signal x(t) is entirely determined by the K shifts tk and 

the K' weights c nr , where 
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which makes at most K+K' degrees of freedom per period x. The 
rate of innovation p is thus 

K + K 1 

p= — ■ 

Applying the new sampling method as in the previous examples, 
5 this signal is first convolved with a sampling kernel of a bandwidth B 
greater than or equal to the rate of innovation p of said first signal x(t), 
then sampled at a frequency greater than or equal to the maximum 
between B and p. Note that even sampling at a frequency p when the 
bandwidth B is greater than the rate of innovation p leads to a limited 
10 number of solutions among which the good solution may often be guessed. 

The so generated sampled values y(nT) will then be sufficient to 
recover the spectral values X[m] using similar steps of the variant 
embodiment of the reconstruction method used in the case where x(t) is a 
periodic stream of weighted Diracs, leading then similarly to the recovery 
15 of the shifts tk and the K' weights c nr . 

We will now extend this result to signals x(t) belonging to the 
class of periodic piecewise polynomial signals of period t, containing in 
each period K pieces of maximum degree R. If we differentiate a periodic 
piecewise polynomial x(t) R+1 times, we obtain a stream of K weighted and 
20 shifted Diracs or derivative of Diracs: 

x (R+,) (t)=£Xc nr 8< r '(t-t n ) 

n=-» r~0 

Periodic piecewise polynomials signals x(t) are thus entirely 
determined by K shifts t k and K'=(R+1)K weights. The rate of innovation p is 

x 



25 
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The Fourier coefficients of the derivative operator is defined by 
D[m] = i2rcm and therefore the Fourier coefficients X (fU1) [m] of the 
differentiated signal x (R+1) (t) are equal to 

X (R+{) [m] = {i2mnfT)* +[ x[m] 
5 with the periodicity conditions t n+ K=t n +T and c n +K,r=c n r for all n. 



This first signal x(t) is entirely determined by the K shifts tk and 
the K'=(R+1)K weights. The rate of innovation p is thus 

p = (R±2*. 



Applying the new sampling method as in the previous example, 
10 x(t) is first convolved with a kernel cp(t) of a bandwidth B greater than or 
equal to the rate of innovation p of said first signal x(t), for example with 
the differentiated sine sampling kernel, or with another differentiated 
kernel. 



We can then take t/T samples regularly spaced apart in order to 
is get a set of values y s [n] from which the periodic piecewise polynomial 
signal of degree R x(t) can be faithfully reconstituted using the previously 
described annihilating filter method. 

A similar reconstruction method can be applied for sampling and 
reconstructing periodic non-uniform splines of degree R, i.e. signals whose 
20 (R+1)th derivative is a periodic stream of K weighted and shifted Diracs. 
Likewise, a similar reconstruction method can be applied for periodic 
filtered piecewise polynomial signals. 

Furthermore, this sampling and reconstruction method can be 
applied to piecewise bandlimited signals, i.e. to signals which are 
25 bandlimited except for jumps or discontinuities. Piecewise bandlimited 
signals can be seen as the sum of bandlimited signals with a stream of 
Diracs and/or with a piecewise polynomial signal: 
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x(t) = XBi_(t) + Xpp(t) where XblCO is a L-Bandlimited signal and x PP (t) 
is a piecewise polynomial signal. 

The Fourier coefficients X[m] are defined by 

\X BL [m] + X rP [m] if me[-L,L] 
1 X„lm] if m*[-L,L] 

5 The Fourier coefficients of the signal x(t) outside of the band 

[-L,L] are exactly equal to the Fourier coefficients of the piecewise 
polynomial. Therefore it is sufficient to take at least 2K(R+1) Fourier 
coefficients outside of the band [-L,L] to retrieve the signal x pp (t). The 
Fourier coefficients of the bandlimited signal are then obtained by 

i0 substracting X PP [m] from X[m] for m e [-L,L]. 

As a piecewise polynomial signal has 2K(R+1) and the 
bandlimited signal 2L+1 degrees of freedom, we can sample the signal x(t) 
using a periodized differentiated sine sampling kernel bandlimited to 
2L+4K(R+1)+1, because of symmetry constraints. 

15 Finite length signals with finite rate of innovation 

A finite length signal with finite rate of innovation p clearly has a 
finite number of degrees of freedom. We will illustrate with several 
examples that those signals can be uniquely specified with a finite set of 
samples, and that the minimal number of samples in the set only depends 
20 on the number of degrees of freedom of the signal, but not on its 
bandwidth. 

Consider first a continuous time signal x(t) with a finite number 
of weighted Diracs: 



k=Q 
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x(t) clearly has 2K degrees of freedom, K from the weights Ck and 
K from the shifts tk of the Diracs. We will see that N samples, N being 
greater than 2K, preferably greater than 2K+1 , will be sufficient to recover 
the signal x(t), and describe an appropriate reconstruction method. Similar 
5 to the previous cases, the reconstruction method will require solving two 
systems of linear equations: one for the shifts of the Diracs and one for the 
weights of the Diracs. 

In a first embodiment, the signal x(t) is filtered with a sine kernel 
<p(t), as an example of infinite length sampling kernel. Sampled values y s [n] 
10 of x(t) are obtained by filtering x(t) with the sinc(t/T) sampling kernel: 

y$[n] = < x(t), sinc(t/T-n)>, n=0,..,N-1 

By developing the inner product one shows that: 

(_n" K ~ ] \ 
y J M = ^— ! -X c * sin(ar 4 /7> 



n fi {t k IT-ri) 
This leads to: 



15 Y„ = (-1)" P{n)y s [n] = -£c, sm(m k IT)P k {n) 



A, 

where P(u) = y £p k u k has zeros at locations t\fT for 1=0,... ,K-1 



k=0 



The right-hand side of this expression is a polynomial of degree 
K-1 in the variable n, thus applying K finite differences makes the left-hand 
side vanish, that is 

20 A* ((-I)" />(«)*,[«]>= 0 for n=K,..,N-1 



»£p 4 A*(H) l, if*^[»]) = o 
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The p k can be retrieved by solving this system. With the p k , the K 
roots of the polynomial P(u) can be retrieved, and thus the shifts t k =Tu k . 
Once the shifts tk have been retrieved, the weights Ck can be found with the 
above described method, i.e. by solving a linear system of equations. 

5 The above method for reconstructing a signal which has been 

filtered by a sine transfer function is easy to carry out and elegant. 
However, in the real world, many signals are measured by a measuring 
device 7 respectively transmitted over a channel 5 having a transfer 
function which can be more precisely approximated by a Gaussian transfer 

10 function cp^t). It can be shown that similar to the sine sampling kernel, 2K 
sample values y 5 [n] obtained by filtering the signal with a Gaussian kernel 
(p 0 (t) are sufficient to represent the signal x(t). 

This can be demonstrated by computing the sample values 
y«[n] = < x(t), e (tAr - n)2/2o2 > = %c k e- (t > n '- n)2,2(Tl 

15 By expanding and regrouping the terms so as to have variables 

that depend solely on n and solely on k, we obtain: 

K-\ 

where we have Y n =e* t2 *y M [n], a k = c k e" ln "* Ti and u k =e t ' f0iT . Y n 
is a linear combination of real exponentials. Thus the annihilating filter 
20 method can be used to find the K values u k and ak. This means that the 
values Uk can be solved by finding the roots of an annihilating filter chosen 
such that 

h*Y = 0 
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From the Uk, the shifts tk can be retrieved using t k = <j 2 T\nu k . 
Once the shifts tk are obtained then we solve for ak a Vandermonde 
equation system. The weights Ck are simply given by c k = a k e' ina>r2 



5 Infinite length signals with local finite rate of innovation 

In this section, we will describe a sampling and local 
reconstruction method for sampling and reconstructing infinite length 
signals x(t) with a finite local rate of innovation p t (t) with respect to a 
moving window of size x. We will in particular describe bilevel signals, and 
io explain local reconstruction methods using sampling kernels with a 

compact support. Those results could be generalized to other B-splines of 
different degree d. 

Bilevel signals x(t) are infinite length continuous-time signals 
which take on two values, 0 and 1, with a known initial condition, for 

15 example x(0) =1. These signals are completely represented by their 

transition values (shifts) tk. Suppose the signal x(t) has a finite local rate of 
innovation p as described above. This is the case of most signals produced 
by electronic digital circuits, where the rate of innovation is usually limited 
by the clocking of the integrated circuit generating the signal. Examples of 

20 common bilevel signals with a finite local rate of innovation include 
amplitude or modulation pulses or PAM, PPM signals among others. An 
example of bilevel signal is shown on Figure 9. 

If a bilevel signal is sampled with a box spline q> 0 (t/T) shown on 
Figure 10, then the sample values y s [n] are given by the inner product 
25 between the bilevel signal and the box function: 



y s [n]=<x(t), q> 0 (t/T-n)> = jx(t)q> 0 (t/T -n)dt 
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The sample value y 5 [n] simply corresponds to the area occupied 
by the signal x(t) in the interval [nT, (n+1)T]. Thus, if there is at most one 
transition per box, then we can recover the transition from the sample. The 
non-bandwidth limited signal x(t) is thus uniquely determined from the 
finite set of samples y s [n]. 

However, if the bilevel signal x(t) is shifted by an unknown shift, 
then there may be two transitions in an interval of length T and one box 
function will not be sufficient to recover the transitions. To sample this 
signal, one can use a sampling kernel cp (t/T) with a larger support and with 
added information. For example, the hat spline function defined by 



leads to two sample values in each interval [nT, (n+1)T] with 
which the maximum two transitions time t k (shifts) in the intervals can be 
uniquely retrieved. 

In fact, if there are at most 2 transitions in the interval [n,n+2], 
then the possible configurations are 

(0,0), (0,1), (0,2), (1,0), (1,1), (2,0) 

where the first and second component indicate the number of 
transitions in the intervals [n, n+1] and [n+1, n+2] respectively. 

Since the hat sampling kernel is of degree one, we obtain for 
each configuration a quadratic system of equations with variables t 0 , ti: 




y„ = J x(W + t-n)dt + \xm~{t-n))dt 



y n+i = J *(0d + *-(« + i))dt + }*(/)(! -(/-(« + V))dt 
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It can easily be shown that this system of equation admits one 
solution and that this solution is unique. 

Similarly, infinite length piecewise polynomial signals with a local 
finite rate of innovation can be sampled and reconstructed with a box 
sampling kernel. Consider an infinite length piecewise polynomial signal 
x(t) where each piece is a polynomial of degree R and defined over an 
interval [tk-i,t k ], that is, 



x(f) = 



m=0 



**(') = X<W te[t K . lt t K ] 



rn~Q 



Each polynomial piece x k (t) contains R+1 unknown coefficients 
10 Ckm. The transition values are easily obtained once the pieces Xk-i(t) and x k (t) 
are determined, thus there are 2(R+1)+1 degrees of freedom. If there is one 
transition in an interval of length T then the maximal local rate of 
innovation is p m (T)=(2(R+1)+1)/T. Therefore, in order to recover the 
polynomial pieces and the transition we need to have at least 2(R+1)+ 1 
is samples per interval T. This can be achieved for example by sampling with 
the following box sampling kernel: 



<Pof f 



2( /? + !) + ! 



) 



20 



For example, if the signal x(t) to reconstruct is a piecewise linear 
signal (R=1) with maximal one transition in each interval T, then we need at 
least 5 samples per interval. 



We can generalize this case by noting that the Rth derivative of a 
piecewise polynomial of degree R is a piecewise constant signal which can 
be sampled and reconstructed using the same method. 
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Multidimensional signals 

The sampling and reconstruction method of the invention is not 
restricted to one-dimensional signals, but can also be used with 
multidimensional signals. For example, an interesting case appears with 
5 two-dimensional images, where bilevel and multi-level signals are quite 
common. Furthermore, many two-dimensional picture signals have a finite 
length and can only be seen through an optical system with a transfer 
function which is at least approximately Gaussian. 

Consider the cases shown on Figures 12, 13 and 14: 

io Figure 12: unit square with a 0/1 transition given by an arbitrary 

function. 

Figure 13: unit square, with a 0/1 transition given by a smooth, 
for example bandlimited, function. 

Figure 14: unit square, with a 0/1 transition given by a piecewise 
L5 polynomial function. 

The sampling and reconstruction method developed in the 
previous sections can be applied on a set of lines, for example on a square 
grid, through the square. Obviously, a perfect reconstruction of the 
boundaries shown on Figures 13 and 14 is possible, but a priori not for the 

20 case illustrated on Figure 12. Depending on the a-priori known class of 
function to which the boundary function belongs, a different sampling 
kernel cp(t) will be used for sampling lines through the image and to allow a 
perfect reconstruction of the image if the sampling is fine enough. For 
instance, if the image is piecewise polynomial with boundaries that are 

25 either bandlimited or piecewise polynomial, then separable one- 
dimensional sampling using spline kernels is possible that allows, with the 
above described method, a perfect reconstruction of the boundary and 
thus of the bilevel image, if the sampling is fine enough, i.e. if the sampling 
rate is higher than the rate of innovation of the boundary function. 
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Instead of scanning a picture along lines with a one-dimensional 
sampling kernel, one can scan it with a two-dimensional sampling kernel. 
Indeed, this is exactly what a scanner or a digital camera does: the image is 
first filtered by the optical system which has a two-dimensional <p(x,y) 
5 transfer function and then sampled at regular intervals by the matrix 
sensor. In fact, the above-described methods can also be applied to two- 
dimensional signals which need to be filtered by a two-dimensional 
sampling kernel and sampled by a two-dimensional sampling system with a 
sampling rate at least equal to the two-dimensional rate of innovation. 

io The newly defined class of signals with finite rate of innovation p 

includes a broad variety of signals of which the examples discussed above 
are only a subset. The new sampling method can however be applied to 
many signals x(t) with a finite rate of innovation p, regularly sampled so as 
to generate a set of sampled values y(nT) at a sampling frequency f=1/T 

is greater than said rate of innovation p, said sampled values y(nT) 

representing entirely the first signal x(t). Depending on the form of the 
resulting equation system which only depends on the class of signal to 
reconstruct, there can be an easy solution method for retrieving the shifts 
and weights. 

20 In the above-described embodiments, the new sampling and 

reconstruction methods are applied to sample and/or reconstruct a 
noiseless first signal x(t). The one skilled in the art will however recognize 
that in applications with noisy conditions, the same methods can be used 
with a higher sampling frequency, thus providing a higher number of 

25 sampled values x(nT). The corresponding equation systems described above 
can then be solved using well-known spectral estimation techniques, such 
as for example the singular value decomposition (SVD) method, in order to 
overcome the uncertainty induced by the noise. 

In the above described embodiments, the sampled signal y s [n] is 
30 used for reconstructing the signal y(t) before sampling, or at least a signal 
x(t) related to y(t) by a transfer function (p(t). The one skilled in the art will 
understand however that the sample values y s [n], or even the sets of shifts 
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tk and weights Ck retrieved from those sample values, can be stored, 
transmitted and processed. In particular, a set of values y s i[n] obtained by 
sampling a first signal yi(t) at a sub-Nyquist rate can be added to a second 
set of values y S 2[n] obtained by sampling a second signal y 2 (t) at a sub- 

5 Nyquist rate. The rate of innovation p s of the signal y s (t)=yi(t)+y 2 (t) is 
obviously the sum of the rates of innovation pi, p 2 of the summed signals 
yi(t) and y 2 (t). Therefore, for the sum of the sampled values to be a 
sufficient representation of y s (t), the number of samples of the signal y s (t) 
in a time interval must be greater than the sum of the number of degrees 

io of freedom of the two added signals in this time interval. Therefore, if one 
wishes to perform some processing operations on the set of sampled 
values, one may increase the sampling rate in order to have a sufficient 
number of samples in the processed signal. 

The sampling method and the reconstruction method of the 
15 invention can be performed by hardware circuits or systems and/or by a 
computer program product, including memories in which a software or a 
firmware has been stored and a computer program product directly 
loadable into the internal memory of a digital processing system and 
comprising software code portions for performing the above described 
20 methods. Accordingly, the invention also relates to a circuit, to a system 
and to a computer program product adapted to carry out the above 
described methods, and to a processing circuit or program for processing 
sets of values obtained by sampling a signal with the above described 
method. 
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